Appl. No. 10/732,781 

Response to Office Action dated 07/29/2008 
Reply to Office Action of 02/07/2008 

IN THE CLAIMS : 

This listing of claims will replace all prior versions, and listing of claims, in 
the Application. 

Listing of claims : 

1. (Currently amended) A speech mak i ng i mprovomont method of using 
stored audio and video data , th e data b ei ng aud i o and v i d e o data of 
part i c i pants recorded at a conference as a speech analysis tooM he 
m e thod comprising th e st e ps of : 

indicating [[an]] a facial expression for which to search from the stored 
video data, the facial expression being that may hav e b ee n exhibited by 
one or more of the participants listening to a dur i ng th e speech at the 
conference to search for ; 

determining, using the stored video data in conjunction with an automated 
facial decoding system, whether at least one participant listening to the 
speech exhibited the indicated facial expression; and 

analyzing , in response to determining that the at least one participant 
listening to the speech exhibited the facial expression, the speech by 
analyzing the stored video data representing the at least one participant 
exhibiting the facial expression and the stored audio data representing 
what was being said in the speech when the at least one participant 
exhibited the facial expression to improve a speaker's speech making 
ability. 

2. (Currently amended) The method of Claim 1 wherein th e ana l yz i ng st e p 
i nc l ud e s th e st e p of analyzing the stored video data representing the at 
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least one participant exhibiting the facial expression and stored audio data 
representing what was being said in the speech when the at least one 
participant exhibited the facial expression includes charting expressions 
exhibited by the at least one participant over time. 

3. (Currently amended) The method of Claim 1 wherein the ana l yz i ng stop 
i nc l udes tho stop of analyzing the stored video data representing the at 
least one participant exhibiting the facial expression and stored audio data 
representing what was being said in the speech when the at least one 
participant exhibited the facial expression includes displaying a 
percentage of time the expression is exhibited by the at least one 
participant. 

4. (Currently amended) The method of Claim 1 wherein tho ana l yz i ng stop 
i nc l udos tho stop of analyzing the stored video data representing the at 
least one participant exhibiting the facial expression and stored audio data 
representing what was being said in the speech when the at least one 
participant exhibited the facial expression includes displaying a 
percentage of participants who exhibited the expression. 

5. (Currently amended) The method of Claim 1 wherein th e ana l yz i ng st e p 
i nc l ud e s th e st e p of analyzing the stored video data representing the at 
least one participant exhibiting the facial expression and stored audio data 
representing what was being said in the speech when the at least one 
participant exhibited the facial expression includes displaying a 
percentage of time participants exhibited an expression. 

6. (Currently amended) The method of Claim 1 wherein th e st e p of 
determining whether at least one participant listening to the speech 
exhibited the indicated facial expression includes th e st e p of passing the 
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data through a r e g i ona l /cu l tura l cultural filter for filtering out the expression 
if it is a r e g i ona ll y/cu l tura ll y culturally based expression. 

7. (Currently amended) The method of Claim 1 wherein th e st e p of 
determining whether at least one participant listening to the speech 
exhibited the indicated facial expression includes the stop of passing the 
data through an individual filter for filtering out the expression if it is an 
expression particular to the participant. 

8. Canceled. 

9. (Currently amended) A computer program product on a computer 
readable storage medium having instructions which when executed by a 
processor for improv i ng sp ee ch e s us i ng use stored audio and video data 7 
tho data bo i ng aud i o and v i deo data of part i c i pants recorded at a 
conference as a speech analysis tool , the computer program product 
instructions comprising instructions for : 

codo moans for enabling a user to indicate [[an]] a facial expression for 
which to search from the stored video data, the facial expression being 
that may hav e b ee n exhibited by one or more of the participants listening 
to a dur i ng th e speech at the conference to s e arch for ; 

cod e m e ans for determining, using the stored video data in conjunction 
with an automated facial decoding system, whether at least one 
participant listening to the speech exhibited the indicated facial 
expression; and 



cod e m e ans for analyzing , in response to determining that the at least one 
participant listening to the speech exhibited the facial expression, the 
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speech by analyzing the stored video data representing the at least one 
participant exhibiting the facial expression and the stored audio data 
representing what was being said in the speech when the at least one 
participant exhibited the facial expression to improve a speaker's speech 
making ability. 

10. (Currently amended) The computer program product of Claim 9 wherein 
the cod e m e ans for ana l yz i ng i nclud e s cod e means instructions include 
instructions for charting expressions exhibited by the at least one 
participant over time. 

11. (Currently amended) The computer program product of Claim 9 wherein 
the ana l yz i ng cod e m e ans includes cod e m e ans instructions include 
instructions for displaying a percentage of time the expression is exhibited 
by the at least one participant. 

12. (Currently amended) The computer program product of Claim 9 wherein 
the ana l yz i ng cod e m e ans inc l udes cod e m e ans instructions include 
instructions for displaying a percentage of participants who exhibited the 
expression. 

13. (Currently amended) The computer program product of Claim 9 wherein 
the ana l yz i ng cod e m e ans i nc l ud e s cod e m e ans instructions include 
instructions for displaying a percentage of time participants exhibited an 
expression. 

14. (Currently amended) The computer program product of Claim 9 wherein 
the d e t e rm i n i ng cod e m e ans i nc l ud e s cod e m e ans instructions include 
instructions for passing the data through a r e g i ona l /cu l tura l cultural filter 
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for filtering out the expression if it is a r e g i ona ll y/cu l tura ll y culturally based 
expression. 

15. (Currently amended) The computer program product of Claim 9 wherein 
the d e t e rm i n i ng cod e m e ans i nc l ud e s cod e m e ans instructions include 
instructions for passing the data through an individual filter for filtering out 
the expression if it is an expression particular to the participant. 

16. Canceled. 

17. (Currently amended) An A sp ee ch mak i ng i mprov e m e nt apparatus for 
using stored audio and video data , th e data b ei ng aud i o and v i d e o data of 
part i c i pants recorded at a conference as a speech analysis tooM he 
apparatus comprising: 

means for indicating [[an]] a facial expression for which to search from the 
stored video data, the facial expression being that may hav e b ee n 
exhibited by one or more of the participants listening to a dur i ng th e 
speech at the conference to search for ; 

means for determining, using the stored video data in conjunction with an 
automated facial decoding system, whether at least one participant 
listening to the speech exhibited the indicated facial expression; and 

means for analyzing , in response to determining that the at least one 
participant listening to the speech exhibited the facial expression, the 
speech by analyzing the stored video data representing the at least one 
participant exhibiting the facial expression and the stored audio data 
representing what was being said in the speech when the at least one 
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participant exhibited the facial expression to improve a speaker's speech 
making ability. 

18. (Original) The apparatus of Claim 17 wherein the analyzing means 
includes means for charting expressions exhibited by the at least one 
participant over time. 

19. (Original) The apparatus of Claim 17 wherein the analyzing means 
includes means for displaying a percentage of time the expression is 
exhibited by the at least one participant. 

20. (Original) The apparatus of Claim 17 wherein the analyzing means 
includes means for displaying a percentage of participants who exhibited 
the expression. 

21. (Original) The apparatus of Claim 17 wherein the analyzing means 
includes means for displaying a percentage of time participants exhibited 
an expression. 

22. (Currently amended) The apparatus of Claim 17 wherein determining 
means includes means for passing the data through a r e g i ona l /cu l tura l 
cultural filter for filtering out the expression if it is a r e g i ona ll y/cu l tura ll y 
culturally based expression. 

23. (Original) The apparatus of Claim 17 wherein the determining means 
includes means for passing the data through an individual filter for filtering 
out the expression if it is an expression particular to the participant. 

24. Canceled. 
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25. (Currently amended) A sp e ech mak i ng i mprov e m e nt system of using 
stored audio and video data , the data b ei ng aud i o and v i d e o data of 
part i c i pants recorded at a conference as a speech analysis tool , th e 
syst e m comprising: 

at least one storage device for storing code data; and 

at least one processor for processing the code data to enable a user to 
indicate [[an]] a facial expression for which to search from the stored video 
data, the facial expression being that may hav e b ee n exhibited by one or 
more of the participants listening to a dur i ng th e speech at the conference 
to s e arch for , to determine, using the stored video data in conjunction with 
an automated facial decoding system, whether at least one participant 
listening to the speech exhibited the indicated facial expression, and to 
analyze , in response to determining that the at least one participant 
listening to the speech exhibited the facial expression, the speech bv 
analyzing the stored video data representing the at least one participant 
exhibiting the facial expression and the stored audio data representing 
what was being said in the speech when the at least one participant 
exhibited the facial expression to improve a speaker's speech making 
ability. 

26. (Original) The system of Claim 25 wherein the code data is further 
processed to chart expressions exhibited by the at least one participant 
overtime. 

27. (Original) The system of Claim 25 wherein the code data is further 
processed to display a percentage of time the expression is exhibited by 
the at least one participant. 
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28. (Original) The system of Claim 25 wherein the code data is further 
processed to display a percentage of participants who exhibited the 
expression. 

29. (Original) The system of Claim 25 wherein the code data is further 
processed to display a percentage of time participants exhibited an 
expression. 

30. (Currently amended) The system of Claim 25 wherein the code data is 
further processed to pass the data through a r e g i ona l /cu l tura l cultural filter 
for filtering out the expression if it is a r e g i ona ll y/cu l tura ll y culturally based 
expression. 
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